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PRELIMINARY AMENDMENT 



Sir: 



Prior to examination on the merits, please amend 
the above-identified application as follows. 



IN THE SPECIFICATION : 

Immediately after the title, please insert the 

following: 

— This application is a division of Application No. 
08/623,536, filed March 29, 1996. — 



IN THE CLAIMS : 

Please cancel Claims 13-18 without prejudice and 
without disclaimer of subject matter. 

Please amend Claim 7 as follows: 

7. (Amended) The apparatus according to claim 6, 
further comprising memory means for storing code data 
[generated by the image processing apparatus described in 
claim 1,] and outputting the code data stored in said memory 
means to said decoding means. 

REMARKS 

This application is a division of Application No. 
08/623,536, filed March 29, 1996. Claims 1-12, non-elected 
as being directed to Species I (Fig. 1) in the parent 
application, are presented now for examination on the merits. 

Claim 7 has been amended above to place the claim 
in proper dependent form. 

An Information Disclosure Statement is being filed 
herewith to cite the information made of record in the parent 
application. Pursuant to § 609 of the MPEP, no copies of the 
cited art are being provided. Of course. Applicant will 



- 2 - 



gladly send duplicate copies of the cited art upon request of 
the Examiner. 

Applicant's undersigned attorney may be reached in 
our New York office by telephone at (212) 218-2100 • All 
correspondence should continue to be directed to our below 
listed address. 



Respectfully submitted, 



u. 
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Attorney for Appl: 
Regi^ration No. S"^ , S^^G 



FITZPATRICK, CELLA, HARPER & SCINTO 
30 Rockefeller Plaza 
New York, New York 10112-3801 
Facsimile: (212) 218-2200 
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TITLE OF THE INVENTION 
IMAGE PROCESSING APPARATUS AND METHOD 
BACKGROUND OF TEIE INVENTION 
Field of the Invention: 
5 This invention relates to an image processing 

apparatus and method. More particularly, the invention 
relates to an image processing apparatus and method for 
high-efficiency encoding and recognition of images, as 
well as to an image processing apparatus and method for 
10 detecting the feature points of an image. 
Description of the Related Art: 

Many image encoding techniques have been developed 
on the basis of filtering theory, which is based upon 
analysis of frequency regions, and information-source 
15 encoding theory. Since the transformation process and 
inverse- trans formation process of these theories have 
structures that are symmetrical to each other, the 
inverse trans format ion is self-evident and it is not 
required that one be aware of the inverse- trans formation 
20 process. For this reason, the conventional encoding is 
referred to as ""symmetric encoding*. 

Symmetric encoding will be described in brief • 
First, the perfoinnance demanded by symmetric encoding is 
as follows : 



(1) Universality: It is required that various 
types of image information be encodable efficiently. 

(2) Compatibility: It is required that 
compatibility between image media having different 
resolutions be assured. To this end, there is need of a 
scheme through which bit strings for various image media 
having different resolutions are obtained if part of an 
encoded bit string is extracted. . 

(3) Fidelity: It is required that a reproduced 
image be close to the original image. This involves 
establishing the concept of distance between images for 
the purpose of evaluating fidelity. 

Rapid progress in symmetric encoding has been made 
in recent years, and sub-band encoding in particular has 
become the focus of much research for the following 
reasons : 

(1) A practical image processing scheme having a 
high degree of compatibility and suited to the service 
layer of image communication is capable of being 
implement with ease. 

(2) A visual spatial frequency characteristic 
modeled accurately in the sub-band region can be 
reflected directly in the control of encoding parameters. 

Described next will be the research trends and 



- 3 - 



technical level relating to transformation and 
quantization techniques, which are the requisite 
techniques of symmetric image encoding. 

With regard to transformation techniques, studies 
5 regarding prediction and orthogonal transformation have 
for the most part been completed, and investigations now 
proceeding deal mainly with band separating/ synthesizing 
filters for siob-band encoding* The three capabilities 
required of a band separating/synthesizing filer are as 
10 follows: 

(1) Perfect reproducibility: In a case where an 
image is reproduced without performing encoding, it is 
required that the original signal be reproduced 
faithfully without causing distortion that accompanies 

15 folding, 

(2) Linear topological characteristic; It is 
required that the filter have a linear or near linear 
topological characteristic in image encoding, 

(3) Orthogonality: There should be no overlapping 
20 of filters for band separation. 

At the present time, the only orthogonal filter of 
finite degree which truly satisfies the requirements of 
a linear topological characteristic and perfect 
reproducibility is the Haar filter (which is equivalent 
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to a second-order quadrature mirror filter) • 

With regard to quantization techniques, an encoding 
characteristic that is near ideal has attained an 
iirtplementable technical level. In high-rate 
5 quantization of an unstored information source, 

combining linear quantization and .entropy encoding of a 
quantized output makes it possible to achieve 
quantization at a quantization loss of approximately 
0-25 bit/sample in comparison with the rate-distortion 

10 limit. In case of quantization at a lower rate, an 

excellent quantization performance can be realized by 
combining scalar quantization, which is equipped with a 
dead zone, and entropy encoding of a quantized output, 
wherein the entropy encoding includes zero-run encoding. 

15 Furthermore, at a low rate, utilization of vector 
quantization also is possible • If use is made of 
lattice vector quantization or a multi-dimensional 
quantization method in which a code book is furnished 
with a certain algebraic structure, as in the manner of 

20 a permutation code, multi-dimensional, high-efficiency 
quantization closer to the rate-distortion limit can be 
realized over a wide range of from low to high rates. 

However, if an image occupies a major portion of 
the information handled, encoding which relies solely 
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upon geometric inforrnation of the information handled is 
insufficient. Accordingly, attempts to carry out 
compression utilizing the structure of an image, namely 
the structure of the actual world, have been studied 
5 from several standpoints. These new attempts have 
already shown that there is no assurance that the 
transformation process and inverse-transformation 
process will be symmetrical. With such encoding, 
therefore, it is required that sufficient consideration 

10 be given to the inverse-transfo2:mation process. Such 
encoding is referred to as "asymmetric encoding" . 

Itie fotindation of the concept of a new type of 
image encoding {referred to as ^'asymmetric image 
encoding"), sometimes called "feature extraction 

15 encoding" or ^structure extraction encoding" does not 
necessarily depend completely upon filtering theory 
alone, as is the case with conventional image encoding 
techniques. With asymmetric image encoding, symbolizing 
and reproduction algorithms are required to have the 

20 following properties: 

(1) When an input image contains noise, it is 
required that fluctuation produced in a featxire 
parameter by such noise be very small. 

(2) A set of input images mapped onto identical 
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feature parameters owing to the symbolizing algorithm 
should be as small as possible • If possible, the 
symbolizing algorithm should be one-to-one mapping to 
feature and structure parameters from the input image. 
5 The feature and structure parameter space and the 
symbolizing algorithm should be complete. 

(3) The reproduction algorithm should be a stable, 
i.e., continuous mapping. More specifically, when noise 
due to coarse quantization appears in a feature 

10 parameter extracted by the symbolizing algorithm, and 

even when the calculation accuracy is unsatisfactory, it 
is required that reproduction of an image close to the 
original image be assured. 

(4) It should be possible to calculate both the 
15 symbolizing algorithm and reproduction algorithm stably 

in nxamerical fashion and in a finite number of steps. 

Asymmetric image encoding presently being studied 
can be classified as follows: 

•Application of IFS (Integrated Function Systems) 
20 Ihe self -similarity (fractal property) believed to 

exist between partial images of an input image is 
utilized to find a reduced mapping proper to each 
partial image, and encoding is attempted on the basis 
thereof. At the present time, an affine transformation 
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is employed as the mapping. Since a reproduced image is 
given as a set of stable points in a dynamic system, the 
image is decoded by recursive processing. 
•Application of edge information 
5 It has long been known that edges provide important 

information in terms of visual information processing. 
A complete description of an image can be achieved by 
combining edge information and appropriate additional 
information. In an image encoding /decoding system that 

10 employs edge information, the position of an edge is 

extracted from an input image by an encoder, a certain 
type of information (e.g., a differential coefficient) 
at this edge position is extracted and the image is 
reproduced by appropriate inte23>olation performed by a 

15 decoder. 

*Use of motion information 

A method of estimating a motion vector as a feature 
parameter and perfonaing encoding using this vector was 
been studied in the field of moving-picture encoding. 
20 More specifically, a moving vector is predicted, three- 
dimensional motion and a three-dimensional structure 
(rule) are predicted on the basis of the predicted 
vector, and on the basis of these a three-dimensional 
structural (rule) model is constructed. The image is 
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encoded/decoded using this three-dimensional structural 
(rule) model. 

At the present time, it is assiamed that when IFS is 
applied in image encoding, the fractal property appears 
5 to the same degree over the entirety of one image. 

However, if a natural image is taken as an example, a 
plurality of objects will be present in one image. 
Therefore, the assumption that there is a fractal 
property over the entirety o£ the natural image can only 

10 mean that the above method is fairly careless. Further, 
the employment of edge information or motion information 
involves many xinsolved technical problems in terms of 
pattern recognition, learning of knowledge, etc. 

As mentioned above, an edge is widely accepted as 

15 the feature of an image. Here an edge refers to a 

portion of the image where there is a large amount of 
change in image intensity (luininance, density, 
saturation and hue) . Edge position is detected as the 
position of the maximal value of the first-order 

20 differential coefficient or as the position at which a 
second-order differential coefficient becomes zero. 
(See F. Ulupinar and G, Medioni: Refining edges 
detected by a LOG operator". Computer vision, graphic 
and image processing, vol, 51, pp. 275 - 298, 1990.) 
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A method of detecting a singularity by multi- 
resolution analysis has been proposed. (See Mallat 
and W*L, Hwang: "^Singularity detection and processing 
with wavelets", IEEE Trans, information theory, vol. 38, 
5 no. 2, pp. 617 - 643, Mar. 1992.) This method performs 
detection based upon the fact that a -singularity 
exhibits a maximal value over all frequency components. 

However, since a first-order differential 
coefficient has the effect of emphasizing noise, a 

10 method of detecting an edge from a first-order 

differential coefficient is susceptible to noise. 
Similarly, a method of detecting an edge from the zero- 
cross point of a second-order differential coefficient 
also is disadvantageous in that the precision of the 

15 position of the detected edge is influenced strongly by 
noise. Further, a method of detecting an edge by multi- 
resolution analysis is highly resistant to the effects 
of noise but involves a large amount of calculation. 
Furthermore, an edge detected by these methods 

20 generally is continuous. If it is attempted to encode 
the original image based upon such an edge, it becomes 
necessary to execute some kind of threshold- value 
processing in order to select a finite ntmiber of feature 
points from a continuously existing edge. 
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SUMMARY OF THE INVENTION 
Aa object of the present invention is to provide an 
image processing apparatus and method in which it is 
possible to execute asymmetric encoding that does not 
5 require the extraction of three-dimensional motion and 
three-dimensional structures . 

According to the present invention, the foregoing 
object is attained by providing an image processing 
apparatus, comprising: transformation means for 

10 transforming data space of an input image to multi- 
resolution space and outputting a multi-resolution 
representation of the input image; detecting means for 
detecting a singularity in the input image; extracting 
means for extracting a local pattern, which is formed by 

15 a spatial arrangement of intensities of the multi- 
resolution representation in a partial area containing 
the detected singularity, with regard to partial areas 
of a plurality of sizes; quantizing means for creating a 
quantization code book based upon the extracted local 

20 pattern and replacing the multi-resolution 

representation by a code word using the code book; and 
encoding means for algebraic encoding code data which 
includes position coordinates of the singularity in the 
multi-resolution representation and the code word 
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provided by the quantizing means • 

Another object of the present invention is to 
provide an image processing apparatus and method in 
which image data are retrieved from a partial image by 
5 applying the aforementioned apparatus and method to 
image recognition. 

According to the present invention, the foregoing 
object is attained by providing cin apparatus further 
comprising memory means for storing degree of conformity 
10 or quantization error, calculated by the quantizing 
means ^ when the local pattern is allocated to a 
representative vector; and deciding means which, on the 
basis of the degree of conformity or quantization error, 
is for deciding the order relating to the perspective 
15 depth between any two representative vectors contained 

in the code data; wherein the encoding means encodes the 
order relating to the perspective depth. 

A further object of the present invention is to 
provide an image processing apparatus and method 
20 strongly resistant to the effects of noise, in which a 
finite number of feature points can be readily obtained. 

According to the present invention, the foregoing 
object is attained by providing an image processing 
apparatus comprising: input means for entering an image; 
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transformation means for transforming data of the input 
image, which is represented by a function on a two- 
dimensional plane entered by the input means, to data of 
a vector field; detecting means for detecting a pole and 
5 a zero point of image data transformed by the 

transformation means; arithmetic means for calculating a 
finite number of expansion coefficients of a polynomial 
expansion about the pole detected by the detecting 
means; and deciding means which, based upon the position 

10 of each pole detected by the detecting means, is for 
deciding an area in which a polynomial expansion of 
finite degree obtained by the arithmetic means about 
each pole can be approximated. 

Other features and advantages of the present 

15 invention will be apparent from the following 

description taken in conjunction with the accompanying 
drawings, in which like reference characters designate 
the same or similar parts throughout the figures thereof. 
BRIEF DESCRIPTION OF THE DRAWINGS 

20 Fig* 1 is a block diagram illustrating the 

constiniction of an image processing apparatus according 
to an embodiment of the present invention; 

Fig, 2 is a diagram showing an example of a spatial 
sampling interval in. a certain scale; 
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Fig. 3 is a diagram showing an example of a local 
pattern of depth A, = 3; 

Fig* 4 is a diagram showing an exanple of a local 
pattern of depth X; 

5 Fig. 5 is a diagram showing an example of a set- 

theoretic order relation which holds true between a 
local pattern with depth k and a local pattern with 

depth X (>k) ; 

Fig. 6 is a diagram showing the manner in which a 
10 perspective order of representative vectors is 
extracted; 

Fig. 7 is a block diagram illustrating the 

construction of an image processing apparatus according 

to a second embodiment of the present invention; 
15 Fig. 8 is a diagram showing an example of a 

coordinate transformation by a wide-view lens 

illustrated in Fig. 7; 

Fig. 9 is a diagram showing a path of integration 

performed by a singularity detector shown in Fig, 7; and 
20 Fig. 10 is a diagram showing an example of division 

of an area by a transformation encoder illustrated in 

Fig. 7. 

DESCRIPTION OF THE PREFERRED EMBOD TMR^3^^c; 
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Embodiments of an image processing apparatus 
according to the present invention will now be described 
in detail with reference to the drawings. 
First Embodiment 
5 Fig. 1 is a block diagram illustrating the 

construction of an image processing apparatus according 
to an embodiment of the present invention. 

As shown in Fig. 1, the apparatus includes an image 
input unit 101, such as an image scanner, for reading 

10 the image of an original and producing an input image 
151. The image input unit 101 is also capable of 
directly entering image data from an image processor or 
corr^uter, not shown. The input image 151 is represented 
by Equation (1) shown below. Further, in a case where 

15 the input image is given as a digital image, it will 
suffice to convert this equation to discrete points. 

AxlxeR' (1) 
A transformation unit 102 transforms the data space 
of the input image 151 to multi-resolution space. By 
20 way of example, multi-resolution space is four- 
dimensional space defined by a one-dimensional scale 
parameter s, a two-dimensional shift parameter b and a 

one-dimensional rotation-angle parameter Q . The input 
image 151 expressed in multi-resolution space is 
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referred to as a multi-resolution representation 152. 
The transformation unit 102 performs a transformation in 
accordance with Equations (2), (3), shown below. In 

Equation (3), R(6) represents a rotation matrix and ^ a 

function referred to as an analyzing wavelet, which 
satisfies the condition of Equation (4) below. Further, 
an image f is reproduced in the manner of Equation (5) 
below. 

< f,<t>,,e >= J^4x^sAe«f(x) ^ (2) 

(l),,,^e(x) = s->(R(er^(— )) (3) 

s 

C. = {2izf f ^— f '"del <|>(rcose,rsin8) P< co (4) 

^ J 0 J 0 



10 In actual calculation, a discrete multi-resolution 

space is convenient. In this case, each parameter is 
set in the manner indicated by Equation (6) below* In 
Equation (6), j represents the depth of a local pattern, 
defined later* This differs from the method of dealing 

15 with parameters used ordinarily in that a shift 

parameter in Equation (6) has a width 2*^^^'^"^*). As 
shown in Fig. 2, the spatial saitpling interval (the 
offset between an interval indicated at 201 and an 
interval indicated at 202) at a certain scale is equal 
20 to a space width 203 of a wavelet base at a scale finer 
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than the above-mentioned scale by an amoimt equivalent 
to the depth of the local pattern. 



^ = 2* 

0 = 7700 



(6) 



In order to avoid confusion, real space coordinates 
5 are adopted as two-dimensional coordinates in real space 
(the image) , and coordinates in multi-resolution space 
are denoted by parameter coordinates • When those having 
rotational symmetry are employed as analyzing wavelets 
<l)x, the multi-resolution space becomes three-dimensional, 

10 with the axis relating to the angle of rotation having 
omitted. In this embodiment, analyzing wavelets having 
rotational symmetry are employed in order to facilitate 
an understanding of the following discussion. However, 
the discussion would be similar even if the angle of 

15 rotation were taken into account. In the diagram used 
for the purpose of explanation, real space is expressed 
by one dimension for the sake of simplicity. 
Transformation in case of a analyzing wavelets having 
rotational symmetry is performed as indicated by 

20 Equation (7) below. 



< f-'^sj,. > = J W = (7) 
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A transformation iinit 103 transforms the multi- 
resolution representation 152 to a representation of 
local pattern space and outputs a local pattern 153 • 

The neighborhood Nx(si,bi) with depth X with respect to a 

5 parameter coordinate (si = s^^^bi) is defined by 

Equations (8), (9) b^low* Fig. 3 is a diagram showing 
an example of a local pattern with depth A. = 3. This 

shows that if the parameter coordinates differ, then the 
region covered by the local pattern, namely the real 
10 space region (the width b) , and the scale region (which 
corresponds to the frequency region of width s) also 
differ. 

s=2\ ;t={fcj,iti-V--.Afax(0,^- A)} (8) 
6=6,±((m-i)2*Ax,(«-i)2*Aj^Xm,/7= {V.-,2*'-*} (9) 

Thus, the neighborhood Nx(si,bi) with depth X is 

15 equal to a quad tree (a binary tree in Fig. 3) including 
the node {si,bi) as the root. The local pattern of 

parameter coordinates (s,b) with depth X is that 

obtained by making the value of the wavelet coefficient 

<0sj,bk> at the parameter coordinates correspond to each 

20 node of Nx,(s,b) . The local pattern space of depth X is 
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referred to as function space established by defining an 
inner product, which is defined by Equation (10) below 
as the set of the quad tree mentioned above (see Fig, 4) . 
The suirtmation on the right-hand side of Equation (10) 
extends over nodes belonging to the local pattern. The 
local pattern space of depth X will be denoted by T^ and 

elements thereof will be denoted by tn e T^ hereinafter. 
«f'^4^U^ >'< S,<l>^s,M>. »'»^= Z< A,.* X S,<1>^^,^^ > (10) 

On the basis of information representing the 
parameter coordinates and depth sent from a quantizer 
105, described later, the transformation unit 103 
extracts the corresponding local patterns in discrete 
multi -resolution space and maps them in local pattern 
space of the respectively corresponding depths. 
Furthermore, the transformation unit 103 counts the 
frequency p(tn) of appearance of each of the local 
patterns tj; and stores this value. 

A singularity detector 1031 detects singularities 
of - an image that has been entered by the image input 
xinit 101, An edge detected by a Laplacian filter or 
Canny filter or a feature point of the image may serve 
as a singularity. 
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On the basis of the frequency p{tn) of appearance 
of the local patterns mentioned above, the code book 

creating unit 104 registers a local pattern tn, at which 
the appearance frequency p has exceeded a suitable value 
5 (threshold value), in a code book as a representative 
vector, and establishes a relationship between the 
representative vector and a codeword. A jth 

representative vector with depth X will be denoted by <^ 

hereinafter. It should be noted that there can be a 
10 case in which the threshold value with respect to the 
occurrence frequency p is set for every depth X and a 
case in which the threshold value is set to be the same 
for all depths X. 

A set of elements for which a set- theoretic order 
15 relation hold true exists between a local pattern with 
depth k and a local pattern with depth X (>k) (see Fig. 

5. An inclusion-relation extractor 1041 connected to 
the code book creation \mit 104 investigates the 
relation between local patterns having different depths. 
20 The order relationship referred to here is indicated by 
Equation (11) below. Vftien trees coincide, this means 
that the values of wavelet coefficients at each node 
coincide. Though local patterns having different depths 
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are correlated by such an order relation, the actual 
data contains an error. Therefore, representation as 
indicated by Equation (12) below using the inner product 
defined earlier is more realistic. 

Among the partial trees d?- >dj^ , if and only if 

there is at least one subtree of 

which coincides with d* (11) 

d^ > d^ , if and only if there is at least one 
subtree of df for which the inner product with dj 
is greater than a certain value (12) 
A quantizer 105 coicpares the multi-resolution 
representation 152 with a representative vector in a 
code book 154. The quantizer 105 performs the 
comparison with regard to local patterns of all depths 
for which representative vectors exist at each of the 
parameter coordinates in multi-resolution space, and the 
local patterns in the neighborhood of each of the 
parameter coordinates are replaced by code words 

corresponding to the representative vector for which 
the above-mentioned inner product is maximized, thereby 
achieving encoding. In a case where the maximal value 
of the inner product does not become greater than a 
certain threshold value, the local pattern which is the 



- 21 - 



object of comparison is adopted as the candidate for a 
representative vector and the parameter coordinates and 
depth thereof are outputted to the transformation unit 
103. As a result of this processing, correspondence 
5 between appropriate code words and all parameter 
coordinates of multi-resolution space is obtained. 

A redundancy eliminating unit 106 compresses an 
image 155 that has been encoded by the above -de scribed 
local pattern. The data encoded using the 

10 representative vectors at each of the parameter 

coordinates are redundant in the sense of the order 
relation between representative vectors close to each 
other in real space (see Fig. 5) . Accordingly, among 
the representative vectors supportive of which in real 

15 space share a common region, the redundancy eliminating 
xinit 106 deletes unnecessary representative vectors 
using the set- theoretical order relation extracted by 
the inclusion-relation extractor 1041. 

A perspective-order computation xinit 107 extracts 

20 the perspective-order relationship with respect to real 
depth in the real space of real objects represented by 
representative vectors from a signal 156 outputted by 
the redundancy eliminating \init 106. There exists some 
pairs of representative vectors close to each other in 
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the real space supportive of which in real space share a 
common region. Accordingly, these perspective-order 
relationships can be obtained depending upon which of 
two representative vectors in nearer than the other to 
5 the wavelet coefficients in the common region. This 
will be described with reference to Fig. 6. 

In order to encode local patterns neighboring each 
of the parameter coordinates, the quantizer 105 
calculates the inner product of the representative 

10 vectors • If a representative vector regarding an object 
situated at the most forward position in real space has 
been acquired and this object is not hidden by anything, 
the inner product between this representative vector and 
a local pattern corresponding to this object will 

15 coincide with the norm of the representative vector in a 
state in which there is no measured error. Local 
patterns 601 and 602 in Fig. 6 are local patterns 
corresponding to such an object (situated at the most 
forward position) . 

20 A local pattern 603 shown in Fig, 6 is a local 

pattern corresponding to an object hidden by another 
object, A common region shared by the support of the 
local pattern 603 and that of the other object (i.e., 
the local pattern 602) in real space is bio and bn. In 
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a region other than this shared region (namely a region 
extending from bll to b 13), the inner product between 
the representative vectors corresponding thereto should 
coincide with the norm. In other words, in the shared 
5 regions blO and bll, it can be predicted that the object 
603 will be hidden by the object 602. Thus, by 
ascertaining the inner product between representative 
vectors at each of the parameter coordinates, the 
perspective-order relationship of the respective local 

10 pattern can be determined. 

An algebraic encoder 108 algebraically encodes an 
output signal 157 from the perspective-order computation 
tmit 107, namely a code word, real space coordinates, 
rotation and scale of a singularity and perspective- 

15 order information, and outputs a code 158. The 

outputted code 158 is stored in a memoiry (not shown) or 
transmitted via a line. 

An algebraic decoder 109 algebraically decodes the 
code 158, which has entered from a memory or line. An 

20 inverse quantizer 110 generates local patterns from the 
code word contained in the algebraically decoded signal 
159 and outputs the local patterns as a signal 160 
indicative of the multi-resolution representation. 
On the basis, of the algebraically decoded real 
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space coordinates, rotation, scale and perspective-order 
information, an image synthesizer 111 combines at least 
two local patterns, which have been generated by the 
inverse quantizer 110, into a single image. The signal 
5 160 is expressed in multi-resolution space. An inverse 
transformation unit 112 inversely transforms the image 
(the multi -resolution representation) , which has been 
synthesized by the image synthesizer 111, to a fiinction 
in real space and outputs a signal 162 indicative of 

10 this function. 

An image output unit 113 is a printer or display 
and forms or displays the image represented by the 
signal 162 . The image output xmit 113 stores the signal 
162 on a recording meditm or outputs the signal 162 to 

15 an image processor or computer, not shown. 

An example has been described in which the 
transformation imit 102 transforms the input image 151 
to multi-resolution space • However, it is also 
effective to transform the input image 151 to a multi- 

20 resolution pyramid. This method involves dividing the 

original image into several (e*g., four) partial images, 
obtaining the mean of the pixel values of each of the 
partial images, subdividing the partial images into 
several partial images and obtaining the mean of each 
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image. By repeating this processing, a multi-resolution 
space approximation of the original image can be 
obtained. 

Thus, in accordance with this embodiment, each 
5 input image can be esqjressed by a plurality of code 

words as well as the positions and sizes thereof or by 
the perspective-order relationship of the representative 
vectors. Further, though innumerable images can be 
generated by movement of a finite number of rigid bodies, 
10 this embodiment makes it possible to compactly express 
an image set of this type. 

More specifically, this embodiment has the 
following effects: 

(1) The perspective-order computation unit 

15 extracts information indicative of a plurality of code 
words, positions corresponding thereto and/or angle of 
rotation and/or scale, as well as information 
representing the perspective-order relationship of any 
two of these representative vectors, contained in the 

20 input image output ted by the quantizer. On the basis of 
the extracted information, the encoder encodes the input 
image. This makes it possible to achieve highly 
efficient encoding. 

(2) The perspective-order computation \init 
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compares the local patterns of one image with those of 
another one using the information extracted in (1) above. 
As a result, the comparison of the local patterns of any 
two images can be performed with ease* 
5 (3) If (2) above is applied to an image 

recognition apparatus, retrieval of image data from 
partial images can be performed with ease. 

(4) By combining the encoding apparatus described 
in (1) above and a decoding apparatus having the 

10 algebraic decoder 109, the inverse quantizer 110 which 
generates local patterns from a plurality of code words 
resulting from decoding and the image synthesizer 111 
for synthesizing local patterns by positions, rotation 
angles and sizes corresponding to the generated local 

15 patterns and the information representing the 

perspective-order relationship of any two representative 
vectors, the amount of data transmitted, if image data 
are to be transmitted, is greatly reduced and the number 
of items of data (images) capable of being stored in a 

20 memory device can be increased. 
Second Embodiment 

Fig. 7 is a block diagram illustrating the 
construction of an image processing apparatus according 
to a second embodiment of the present invention. 
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As shovTn in Fig. 7, the apparatus includes an image 
input unit 1108 having a wide-view lens 1101, an array 
sensor 1102 and an input -parameter controller 1106, the 
details of which will be described later. Light that 
5 has passed through the wide-angle lens 1101 impinges 

upon the array sensor 1102, which converts the light to 
an image signal and outputs the image signal. 

A transformation unit 1103 applies processing, 
described later, to the image signal that has entered 

10 from the image input unit 1108. A singularity detector 
1104 applies processing, described later, to a signal 
that has entered from the transformation unit 1103, A 
transformation encoder 1105 applies processing, 
described later, to a signal that has entered from the 

15 singularity detector 1104 and outputs a code to an 
information processor 1107 . 
[Wide-view lens 1101] 

Fig. 8 is a diagram showing an example of a 
coordinate transformation performed by the wide-view 

20 lens 1101. In Fig. 8, x represents the radius of a 

polar coordinate system on an image plane situated on 
the front side of the input system, an t represents the 
radius of the polar coordinate system after a 
transformation perfoarmed by the wide-view lens 1101, 
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Since this optical system is rotationally symmetric , the 
description given below will rendered solely with regard 
to the radial direction. 

If we let (j> represent the angle of incidence with 
5 respect to the optic axis and ^ the focal length of a 

lens having the radius of the circle shown in Fig. 8, 
the radii t and x will be represented by the following 
equations , respectively : 

r = 2^tan(0/2) (13) 
x = ^tan(0) (14) 

10 On the basis of Equations (13), (14), the radius x 

can be expressed by the equation below as a function of 
the radius t. This is the coordinate transformation in 
the wide-view lens 1101 • 

15 The pattern (function) of frequency f(0), in the 

radial direction, which spreads oyer the entirety of the 
image plane is changed to the following function by the 
wide-view lens 1101: 

/(0-/(0)illi4^ll (16) 

JKJ J \ J l+(^)2 ^ ^ 

20 Of course, in a case where an arbitrary object 

present in three-dimensional space is adopted as the 
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siibject, it will suffice to know only the relationship 
between the incidence angle ^ and the radius t. 

Accordingly, the coordinate transformation becomes as 
follows: 



The coordinate transformation performed by the 
wide-view lens 1101 described above is a confoimal map. 
Accordingly, singularities not present in the original 
image do not arise. 
10 [Array sensor 1102] 

If we let <t)j (x) represent the integral kernel, the 

output gj of a jth (counting from the center of the 
optic axis) array sensor 1102 will be represented by the 
following: 



[Transformation xinit 1103] 

Ihe transformation unit 1103 causes a gradient V to 

act upon an image f (x,y) which is a fxinction in two- 
dimensional space, thereby generating a vector field. 



5 



^=2|tan(^/2) 



(17) 



15 



^\yt^Mt.mix{t;^)) (18) 



er(x,y) = Vf (x,y) 



20 




(19) 
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where el,e2 are components of basis. 

Further, g{x,y) can be expressed as follows: 

g(z)=r(^)exp(0(z)) (20) 
z^x-^fy (21) 

K^)=l I V/(x,>^)!l= / dxf + (df I dyf (22) 

ei2) = arg(V/(x, y)) = arctan(^(^) (23) 

df f dx 

Complex representation is used in the description 
5 given below. 

[Singularity detector 1104] 

The singularity detector 1104 detects singularities 
by utilizing the argument principle. The argument 
principle will now be described. Let a fimction f (z) be 
10 a meromorphic in a simply-connected region D, and let C 
represent a simple closed curve having a positive 
direction within D. Assume that there is neither a zero 
point nor pole present on the closed c\irve C. In the 
interior of the closed cxizve C, assxicne that the function 
15 f (z) has a zero point of order at each of a}^ (k = 1, 

2, — , m) and a pole of order |ik at each of bk (k = 1, 
2, — , n) . When starting from a point Zq on the closed 
curve C and returning to the point Zq upon making one 
full revolution of the closed curve, the amount of 
20 increase Ac arg[f(z)] of the argument of the function 
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f (z) is given by the following equation if we let N^, Np 
represent the nimbers of zero points and poles, 
respectively, within the closed cvirve C: 

Acarg(/(z)) = 2jt{N^if)^N^(f)} (24) 

5 A method of utilizing the argument principle to 

detect a feature point of a vector field {gm,n>m,n 
quantized in space will now be described. 

Step 1: Any point Zk,p = Tk^p-expCOk^p) in a defined 

region of an image is selected, 
10 Step 2: A circle C centered on z^^p and having a 

suitable radius p is considered. 

If this operation is performed, the following 
equation holds true with respect to a number (g) = 2x,k 
of zero points and a nimber Np(z) = of poles, which 

15 reside within the circle C, of the complex function g(z) 
in consideration of their orders obtained by the vector- 
field constructing unit (transformation imit 1103) in 
accordance with the argument principle. 

iV.(f)-^/?)=^^^^ (25) 

20 Accordingly, by considering a circle having a 

radius of one pixel and centered on each pixel of a 
given image, the difference between the nijmbers of zero 
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points and poles at all pixels is obtained using the 
above-described argument principle* At this time, the 
zero points or poles included in each circle are 
considered to be one at most. Therefore, a zero point 
5 is included when the right side of Equation (25) is 
positive and a pole is included when the right side of 
Equation (25) is negative. Accordingly, a center pixel 
when a pole is determined to be present is detected as 
the position of a singularity. 
10 Here Ac arg[g(z)] is calculated in the manner 

described below (see Fig. 9, which illustrates an 
integration path) . The integration path may be a closed 
curve and is not limited the size i^hown in Fig. 9. 



Acarg(g(z))U^^^ 

)) + rigi^m^A )> g(^m-l^ )) 

n(g(^^^i I g(^„^-i )) + rigi^^i^l gC^n^i^ )) (26) 



[Transformation encoder 1105] 

In order to divide the defined region of a vector 
field into a plurality of areas based upon the positions 
of poles, it will suffice to divide the defined region 
20 in such a manner* that only one pole, for example, is 



15 




-argy if argx -arg>^ <;r 
arg^-argjc otherwise 



(27) 
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included {see Fig. 10, which shows an example of 



dividing a region) . If this expedient is adopted. 



convergence of the Laurent series around the pole is 



guaranteed in each region except the pole. 



5 



In order to functionally approximate the 



partitioned vector field around each pole in the range 
of the region corresponding thereto, if the positions of 



well as the order are already known, the function w(2) 
10 can be expressed by Equations (28) through (3 0) below 

based upon the pole positions and orders aj^mj (j = 1, 2, 
J) and the zero-point positions and orders b)t,nk (k 
= 1, 2, • • • , K) . In a case where the zero point 
position and order cannot be specified, an orthogonal 
15 polynomial expansion can be employed. By using the 

Laurent series expansion around each pole to approximate 
each region, a reduction in error can be expected in a 
case where a large area is expressed by one fiinction* 



the poles and zero points within the partial area Dj as 



-i^r (28) 





(29) 




(30) 



20 



[Input-parameter controller 1106] 
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The input-parameter controller 1106 controls the 
rotational angle of the optic axis of wide-view lens 
1101 based upon control information of the rotational 
angle of the optic axis that has entered from the 
5 information processor 1107. The infoirmation processor 
1106 calculates the amount of control of the rotational 
angle of the optic axis in such a manner that a 
singularity is taken on the optic axis. 

Thus, by regarding visual information, which serves 

10 as a function on a two-dimensional plane, as one 

variable complex function, it is assured that the poles 
and zero points of the coirplex fimction will be isolated 
so long as the fxmction is not a constant. In a case 
where the function is a constant, it will not contain 

15 any information and may therefore be ignored. 

Accordingly, in accordance with this embodiment, a 
finite nxmber of singularities can be obtained naturally 
and with facility. 

The apparatus is strongly resistant to noise* For 

20 exaitple, iitpulse noise is detected as an edge in the 
method that relies upon both first-order and second- 
order differentiation. However, in the method of 
generating a vector field and detecting the singularity 
thereof, impulse noise is detected as a zero point. 
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Accordingly, if a pole is employed as a singularity, as 
mentioned above, impulse noise has no effect whatsoever 
upon singularity detection. Adopting a pole and not a 
zero point as a singularity is appropriate from the 
5 viewpoint of function approximation. The reason for 

this is that the deciding factor of converging radius in 
case of series expansion is the position of a pole; a 
zero point plays no part whatsoever. 

Thus, this embodiment can be suitably applied to 
10 image processing such as extraction of feature points 
and encoding/decoding of images. 



Other Embodiment 

The present invention can be applied to a system 
15 constituted by a plurality of devices (e.g., host 

computer, interface, reader, printer) or to an apparatus 
comprising a single device (e.g., copy machine, 
facsimile) . 

Further, the object of the present invention can be 
20 also achieved by providing a storage medixm storing 

program codes for performing the aforesaid processes to 
a system or an apparatus, reading the program codes with 
a computer (e.g., CPU, MPU) of the system or apparatus 
from the storage medium, then executing the program. 
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In this case, the program codes read from the 
storage medixam realize the fxmctions according to the 
embodiments, and the storage medixam storing the program 
codes constitutes the invention. 
5 Further, the storage medium, such as a floppy disk, 

a hard disk, an optical disk, a magneto-optical disk, 
CD-ROM, CD-R, a magnetic tape, a non-volatile type 
memory card, and ROM can be used for providing the 
program codes. 

10 Furthermore, besides aforesaid fxmctions according 

to the above embodiments are realized by executing the 
program codes which are read by a computer, the present 
invention includes a case where an OS (operating system) 
or the like working on the computer performs a part or 

15 entire processes in accordance with designations of the 
program codes and realizes fxmctions according to the 
above embodiments. 

Fxirthermore, the present invention also includes a 
case where, after the program codes read from the 

20 storage medium are written in a fxmction expansion card 
which is inserted into the computer or in a memory 
provided in a fxmction expansion xmit which is connected 
to the computer, CPU or the like contained in the 
fxmction expansion card or xmit perfo3ntis a part or 
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entire process in accordance with designations of the 
program codes and realizes fxmctipns of the above 
embodiments . 

As many apparently widely different embodiments of 
the present invention can be made without departing from 
the spirit and scope thereof, it is to be understood 
that the invention is not limited to the specific 
embodiments thereof except as defined in the appended 
claims . 
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WHAT IS CIiAIMED IS: 

!• Aq image processing apparatus, comprising: 

transformation means for transforming data space of 

an input image to multi-resolution space and outputting 
5 a multi-resolution representation of the input image; 

detecting means for detecting a singularity in the 

input image; 

extracting means for extracting a local pattern, 
which is formed by a spatial arrangement of intensities 

10 of the multi -resolution representation in a partial area 
containing the detected singularity, with regard to 
partial areas of a plurality of sizes; 

quantizing means for creating a quantization code 
book based upon the extracted local pattern and 

15 replacing said multi-resolution representation by a code 
word using the code book; and 

encoding means for algebraic encoding code data 
which includes position coordinates of the singularity 
in said multi-resolution representation and the code 

20 word provided by said quantizing means. 

2. The apparatus according to claim 1, further 
comprising counting means for counting frequency of 
occurrence of said local pattern, wherein said 
quantizing means creates a code book based upon results 
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of counting performed by said coxinting means, 

3. The apparatus according to claim 2, further 
comprising structtiring means for detecting an inclusion 
relation of any two representative vectors that have 
been registered in said code book, and structuring said 
code book, 

4. The apparatus according to claim 3, further 
comprising: 

memory means for storing degree of confoinnaity or 
quantization error, calculated by said quantizing means, 
when the local pattern is allocated to a representative 
vector; and 

deciding means which, on the basis of the degree of 
conformity or quantization error, is for deciding the 
order relating to the perspective depth between any two 
representative vectors contained in the code data; 

wherein said encoding means encodes the order 
relating to the perspective depth. 

5. An image processing apparatus comprising the image 
processing apparatus described in claim 4, wherein said 
image processing apparatus is applied to image 
recognition to retrieve image data from a partial image. 

6. An image processing apparatus comprising: 

decoding means for decoding a code generated by the 
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image processing apparatus described in claim 4; 

inverse quantizing means for generating a local 
pattern from a code word contained in code data decoded 
by said decoding means; and 
5 synthesizing means for combining a plurality of 

local patterns, which have been generated by said 
inverse quantizing means, based upon position 
coordinates of a singularity decoded by said decoding 
means, and order information relating to depth of a 
10 plurality of representative vectors. 

7. The apparatus according to claim 6, further 
coitprising memory means for storing code data generated 
by the image processing apparatus described in claim 1, 
and outputting the code data stored in said memory means 

15 to said decoding means. 

8. An image processing method, comprising: 

a transformation step of transforming data space of 
an input image to multi-resolution space and outputting 
a multi-resolution representation of the input image; 
20 a detecting step of detecting a singularity in the 

input image; 

an extracting step of extracting a local pattern, 
which is formed by a spatial array of intensities of 
said multi-resolution representation in a partial area 
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containing the detected singularity, with regard to 
partial areas of a plurality of sizes; 

a quantizing step of creating a quantization code 
book based upon the extracted local pattern and 
5 replacing said multi -resolution representation by a code 
word using the code book; and 

an encoding step of algebraically encoding code 
data which includes position coordinates of the 
singularity in said multi-resolution representation and 
10 the code word obtained at said quantizing step. 

9, The method according to claim 8, further comprising 
a counting step of counting frequency of occurrence of 
said local pattern, wherein said quantizing step creates 
a code book based upon results of counting obtained at 

15 said counting step. 

10, The method according to claim 9, further comprising 
a structuring step of detecting an inclusion relation of 
any two representative vectors that have been registered 
in said code book, and structuring isaid code book. 

20 11. The method according to claim 9, further 
comprising: 

a calculating step of calculating, at said 
quantization step, degree of conformity or quantization 
error when the local pattern is allocated to a 
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representative vector; and 

a deciding step which, on the basis of the degree 
of conformity or quantization error, is for deciding the 
order relating to the perspective depth between any two 
5 representative vectors contained in the code data; 

wherein said encoding step encodes the order 
relating to the perspective depth • 

12. The method according to claim 11, further 
comprising : 

10 a decoding step of decoding a code encoded at said 

encoding step; 

an inverse quantizing step of generating a local 
pattern from a code word contained in code data decoded 
at said decoding step; and 

15 a synthesizing step of combining a plurality of 

local patterns, which have been generated at said 
inverse quantizing step, based upon position coordinates 
of a singularity decoded at said decoding step, and 
order information relating to perspective depth of a 

20 plvurality of representative vectors, 

13. An image processing apparatus comprising: 

input means for entering an image; 
transformation means for transforming data of the 
input image, which is represented by a function on a 
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two-dimensional plane entered by said input means, to 
data of a vector field; 

detecting means for detecting a pole and a zero 
point of image data transfoinned by said transformation 
5 means ; 

arithmetic means for calculating a finite number of 
expansion coefficients of a polynomial expansion about 
the pole detected by said detecting means; and 

deciding means which, based upon the position of 
10 each pole detected by said detecting means, is for 
deciding an area in which a polynomial expansion of 
finite degree obtained by said arithmetic means about 
each pole can be approximated. 

14. The apparatus according to claim 13, wherein said 
15 detecting means detects the pole and zero point by the 

arg\ament principle. 

15. The apparatus according to claim 13, further 
comprising calculating means for calculating amoimt of 
control of an input parameter of said input means based 

20 upon the pole. 

16. The apparatus according to claim 15, wherein said 
input means has a wide-view lens and an array sensor and 
controls angle of rotation of an optic axis based upon 
the amount of control. 
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17. An image processing method comprising: 
an input step of entering an image; 

a transformation step of transforming data of the 
input image, which is represented by a function on a 
5 two-dimensional plane entered at said input step, to 
data of a vector field; 

a detecting step of detecting a pole and a zero 
point of image data transformed at said transformation 
step; 

10 an arithmetic step of calculating a finite number 

of expansion coefficients of a polynomial expansion 
about the pole detected at said detecting step; and 

a deciding step which, based upon the position of 
each pole detected at said detecting step, is for 

15 deciding an area in which a polynomial expansion of 
finite degree obtained at said arithmetic step about 
each pole can be approximated. 

18. The apparatus according to claim 13, further 
comprising a calculating step of calculating amount of 

20 control of an input parameter of said input step based 
upon the pole. 
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ABSTRACT OF THE DISCLOSURE 

A transformation unit 102 transforms an entered 
image to multi -resolution space. A quantizer 105 
performs vector quantization on a local pattern of an 
5 image of a multi-resolution representation. A 

perspective -order calculating unit 107 extracts a 
plurality of code words, positions corresponding thereto 
and/or angle of rotation and/or scale, and the 
perspective-order relationship of a plurality of these 
;^ 10 representative vectors, from the quantized image. An 

JTJ algebraic encoder 108 encodes the input image based upon 

5 the extracted information. As a result, there are 

provided an image processing apparatus and method for 
yS asymmetric encoding without motion in three dimensions 

Ij 15 and extraction of a three-dimensional structure. Further, 

^1 a transformation unit 1103 transforms an entered image to 

vector field, and a singularity detector 1104 detects a 
singularity in the transformed image. A transformation 
encoder 1105 partitions the vector field into areas which 
20 include detected feature points, and each area is encoded 
by functional approximation. As a result, a finite 
number of feature points can be obtained with ease and an 
image processing apparatus and method exhibiting strong 
resistance to the effects of noise are provided. 



1/9 



(5 




CO 



CM 



CM 
CO 



.CO 



O 
CO 



2/9 




4 /9 



•i? ^° 2° 2o 3o 3o 3o 3o 

f ^ f f f 4? f f 

1° 3o So So 3o So So So 

g go O-" ii 

-^^ -^^ -fi 

°? oie» ™ 

iJ? -1® -io Jio ^o 3o So 

-e--e- -e--e--e--e- -e- 

^^^«4^bB dobo bo 
vvvvvvvv 

I , I L_J LI L 



Lli 



r 

A A A A 

« CO CO 

-a? -S? 

I I r I 
•°- 

'T' ^ 

tf? iJ? 
^ ^ ^ Ol 

^ ^ bB bo ^ 

V V V V ^ 

o 



L 



o 



CQ 



V V 



5/9 




6 /9 




7/9 



d 



CO 



o 



in 
o 



1 



1 



P = 

CO 



1 



^ Q 
CO 



O 




8/9 



FIG. 8 




FIG. 9 

l^f^EGRATION PATH C 





Sm,n+1 


Sm+l,n+l 






Sm+l,n 









9/9 




copy 

COMBINED DECLARATION AND POWER OF ATTORNEY 
FOR PATENT APPLICATION 

As a below named inventor, I hereby declare that: 

My residence, post office address and citizenship are as stated below next to my 

name; 

I believe I am the original, first and sole inventor (if only one name is listed 
below) or an original, first and joint inventor (if plural names are listed below) of the 
subject matter which is claimed and for which a patent is sought on the invention entitled 

IMAGE PROCESSING APPARATUS AND METHOD 

the specification of which 

[x]is attached hereto. [ ] was filed oil as 

Application No. and was amended on 

(if applicable), 

I hereby state that I have reviewed and understand the contents of the above 
identified specification, including the claims, as amended by any amendment referred to 
above. 

I acknowledge the duty to disclose information which is material to the 
examination of this application in accordance with Title 37, Code of Federal 
Regulations,! 1 .56(a). 

I hereby claim foreign priority benefits under Title 35, United States Code, §119 
of any foreign application(s) for patent or inventor's certificate Usted below and have also 
identified below any foreign application for patent or inventor's certificate having a filing 
date before that of the apphcation on which priority is claimed: 



(Yes/No) 

Country A pplication No. Filed (Day/Mo.Afr.) Priority Claimed 

JAPAN 7-076510 31/03/1995 Yes 

JAPAN 7-076515 31/03/1995 Yes 

I hereby appoint Joseph M. Fitzpatrick (Registration No. 17,398), Lawrence F. Scinto (Registration No. 18,973), 
William J. Brunet (Registration No. 20.452), Robert L. Baechtold (Registration No. 20,860), John A. O'Brien (Registration No* 
24,367), John A. Krause (Registration No. 24.613), Henry J. Renk (Registration No. 25.499), Peter Saxon (Registration No 
24,947), Anthony M. Zupcic (Registration No. 27,276), Charles P. Baker (Registration No. 26.702). Stevan J. Bosses (Registration 
No. 22,291). Edward E. VassaUo (Registration No. 29,117), Ronald A. Qayton (Registration No. 26,718), Lawrence A. StaW 
(Registration No. 30,110), Laura A. Bauer (Registration No. 29.767), Leonard P. Diana (Registration No. 29.296), David M 
Quinlan (Registration No. 26,641). Nicholas N. Kallas (Registration No. 31.530). William M. Wannislgr (Registration No 
28.373). Lawrence S. Perry (Registration No. 31,865), Robert H. Fischer (Registration No. 30.051). Christopher Philip Wrist 
(Registration No. 32,078). Gary M. Jacobs (Registration No. 28.861), Michael K. O'Neill (Registration No. 32,622), Bruce C 
Haas (Registration No. 32,734). Scott K. Reed (Registration No. 32,433). Scott D. Malpede (Registration No. 32.533) Fredrick 
M. ZuUow (Registration No. 32,452), Richard P. Bauer (Registration No. 31.588). Warren E. Olsen (Registration No 27,290) 
Abigail F. Cousins (Registration No. 29,292), Steven E. Warner (Registration No. 33.326). Thomas J. O'Connell (Reastration No* 
33,202), Aaron C. Deditch (Registration No. 33.865), Penina WoUman (Registration No. 30,816), David L Schaeffer 
(Registration No. 32,716). Jack S, Cubert (Registration No. 24.245). Mark A. WilUamson (Registration No 33 628) John T 
Whelan (Registration No. 32,448). Jean K. Dudek (Registration No. 30.938), Raymond R. Mandra (Registration No* 34 382) 
Dominick A. Conde (Registration No. 33,856), Steven C. Bauman (Registration No. 33.832). Pasquale A. Razzano (Registiation 
No. 25,512), John W. Behringer (Registration No. 23,086), Robert C. Kline (Registration No. 17,739). Benjamin C Hsine 
(Registration No. 34^28), Mark J. Itri (Registration No. 36.171). WiUiam C. Hwang (Registration No. 36,169), Karin L WiiUanis 
(Registration No. 36.721). Michael P. Sandonato (Registration No. 35.345). Jack M. Arnold (Registration No. 25,823) John D 
Carlin (Registration No. 37.292). Daniel S. Glueck (Registration No. 37,838), Victor J. Geraci (Registration No. 38.157) John j' 
Cotter (Registration No. 38,116), Joseph W. Ragusa (Registration No, 38.586), Brian L, Klock (Registration No. 36.570). Anne 
M. Maher (Registration No. 38,231). and William J. Zak, Jr. (Registration No. 38,668) my attorneys to prosecute this application 
and to transact all business in the Patent and Trademark Office connected therewith. 
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